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1 Introduction 


The cutting angle method is a powerful technique that can solve a wide range 
of global optimization problems based on abstract convexity. This method 
was proposed in 1999 as a method of global Lipschitz optimization and is 
a deterministic global optimization technique that involves constructing a 
sequence of lower approximations to an objective function [2]. In fact, this 
method was developed as a generalization of the cutting plane method of 
convex minimization. The original optimization problem is replaced by a 
sequence of relaxed auxiliary problems that are based on the lower approx- 
imations. Through this process, the sequence of global minimum solutions 
of the relaxed problems eventually converges to the global minimum of the 
original objective function. The articles [1, 3] discussed a method for globally 
minimizing an increasing positively homogeneous function over the unit sim- 
plex S = {x = (21,...,¢n) € RY: 7, vj = 1}. They provided a thorough 
examination of this method. In addition, Ferrer, Bagirov, and Beliakov [6] 
employed the cutting angle method to solve the problem of minimizing the 
difference of two convex functions. 

A function f : R” —> R is classified as topical if it is increasing in the 
natural partial ordering of R” and plus-homogeneous, meaning that f(a + 
Al) = f(x) +4 for all x € R” and all A € R, where 1 denotes the vector 
of the corresponding dimension with all components equal to one. Topical 
functions have been studied in [7, 8, 10] and have found numerous applications 
in different areas of applied mathematics, particularly in the modeling of 


discrete event systems (see [7]). 


Functions that are both increasing and plus-sub-homogeneous are referred 
to as sub-topical functions, which are viewed as a natural extension of topical 
functions [4]. The class of sub-topical functions is one of the most important 
classes of abstract convex functions. In [8, 10], the authors showed that every 
sub-topical function defined on R” can be characterized as an abstract convex 
function with respect to a set DL that is called the set of elementary functions. 
For each y € R” and each a € R, the function yy.) : R" — R is defined 
by 

Piy,a)(x) =sup{AER:A<a, Al<ax+y} forall eR", 
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where 


L={¥iy,0): y € R", a € R}. 


It is worth noting that DL is a more general class of functions than the class 


of min-type functions [8, 9]. 


Here, we study the problem 


min f(z), 


where f : RR” — Risasub-topical function and S, is a simplex in R”; that is, 
Sa = {x = (a1,---,2n) € RY: iy G = 1, where a = (a1,...,@n) € RY. 
We developed a version of the cutting angle method to solve this problem. 
The rest of this paper is organized as follows. Section 2 presents definitions 
and preliminary results on sub-topical functions. In Section 3, a cutting angle 
method is proposed for finding the global minimizers of sub-topical functions 
over a simplex. Then, we present an approach to the numerical solution of 
the subproblem of the algorithm. Finally, Section 4 presents the results of 


numerical experiments. 


2 Preliminaries 


Let R% denote the cone of all n-vectors with nonnegative coordinates. We 
assume that the usual order relation is defined in this cone as follows. For 


v= (41,...,%n) € R” and y = (y1,---, Yn) € R", « < yif and only if a; < y 


for all 7. A function f : R" —+ R = [-oo, +00] is said to be increasing if 
f(x) < f(y) for each x, y € R” such that x < y. The function f is called plus 
sub-homogeneous if f(a+A1) < f(x) +A for all x € R” and all \ > 0, where 
1 = (1,...,1) € R”. It is easy to see that f is plus sub-homogeneous if and 
only if f(a +Al1) > f(x) +. for all « € R” and all A < 0. The definitions 


and results that follow can be found in [9, 10]. 


Definition 1. A function f : R” — R is called sub-topical if it is increasing 


and plus sub-homogeneous. 
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Remark 1. A function f : R” —> R is called topical if it is increasing and 
f(a@+Al1) = f(x) +A for all 2 € R” and all \ € R. It is clear that any topical 


function is sub-topical. 


Lemma 1 (see [10]). Let f : R"” —> R be a sub-topical function. The 


following statements hold: 


(i) If f(~) = +co for some x € R”, then f is identically equal to +00. 


(ii) If f(a) = —oo for some a € R”, then f is identically equal to —oo. 


Lemma 1 implies that a sub-topical function is either finite (i.e., finite- 
valued at each x € R”) or identically +c0 or —oo. Therefore, in the remainder 
of the paper, we only consider finite-valued sub-topical functions. Here are 


some simple examples of finite-valued sub-topical functions. 


Example 1. Any sub-linear function f : R” —> R such that f(1) < lis plus 


sub-homogeneous. So, an increasing and sub-linear function is sub-topical. 


Example 2. Any function of the form 


where a; € R”, a; > 0, i = 1,2,...,n, and @ > maxj<j<n(ai,1), is sub- 


topical. Indeed, 


f(@+Al1) = sin (s~ elaietAl)) 
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The set I of all sub-topical functions f : R” —> R has several notable 


properties, which we will mention below. 
(1) We have P+ R =T, that is, if f¢€P andy eR, then f+y7eT. 
(2) Tis a convex set. 


(3) Let f; €T for 1 <i< K, and let 


Then the functions f and f belong to LT. 


(4) [T is a complete lattice, that is, if {fs}gep is an arbitrary family of 
elements of P and 


f(x) = sup fa(z), (# € R”), 
BEB 


then the function f belongs toT. 


Remark 2. If f : R” — Ris asub-topical function, then f is continuous on 
R”. Indeed, consider an arbitrary point « € R” and a sequence {z,} C R” 
that 2, —> x. Let « > 0 be arbitrary. Then, there exists kg > 1 such 
that « —el < a, < «+1 for all k > ko. Since f is increasing and plus 


sub-homogeneous, it follows that 
f(a) —e< f(w—e1) < flap) < flew +e1) < f(a) +e forall k > kp. 
This implies that f(x.) —> f(x), which shows that f is continuous at 2. 


Now, we recall some definitions from abstract convexity (see for more details 
[9, 12]). Consider a set X and a set H of functions h : X —> R. The function 
f : X — R is called abstract convex with respect to H (or H-convex) if 
there exists a subset U of H such that 


f(x) =suph(x), (aE X). 
heU 


The set H is called the set of elementary functions. Consider the function 
yp: R” x R” x R — R defined by 
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p(x, y, a) = min (ae, te + yi}, (z, yER", a€R). 
1l<i<n 


Let (y,a) € R" xR be arbitrary. Denote by yy.) the function defined on R” 
by the formula Yiy,.)(x) = p(z,y,a). Let Xp = {Yiy,a) : y € R", a € R}. 
Then it is known that any function f defined on R” is sub-topical if and only 


if f is X.,-convex (see for more details [5, Theorem 3.2]). 
Theorem 1. (see [5, Theorem 3.1]) The function f : R" —> R is sub-topical 
if and only if it satisfies the following inequality: 


f(t) = Yy,a)(z) + f(-y+al1)—a forall z, y¢€ R” forall a€R. (1) 


Inequality (1) implies the following statement. 
Proposition 1. (see [5, Theorem 3.2]) Let f : R” —> R be a sub-topical 
function and let  € R”. Put 7 = —€+ f(%)1 and a = f(z). Then yg,a)(x) < 
f(z) for all c € R” and yg,a)(Z) = f(z). 


Remark 3. Let @ € S., ¥ = —%+ f(#)1 and let @ = f(Z). Define the 


function yy as follows: 
g(a) = min {i+ Gi}, (# € Sa). (2) 


Then for each « € Sq we have ¥(g,5)(x) = py(x). Indeed, since Z, x € Sq, 
we get D>), “—*! = 0. This implies that there exists 1 < ig <n such that 


Lig — Lig < 0. Therefore 
Lig + Yio = Lin — Lig + f(z) < f(z) =a. 


Hence, mini<i<n{@,2i + ¥;} = Mini<i<n{vi + J}. 


3 Cutting angle method 


We now present the cutting angle method for finding a global minimizer of 


the problem 


i 3 

min f(z), (3) 

where f : R” —> R is a sub-topical function and S, = {x = (a,...,%n) € 
RY}: Dje1 & = 1}, where a = (a1,...,@n) € R44. The ith unit vector is 
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denoted by e; = (0,...,0,1,0,...,0). It is worth noting that, if x? = a;e;, 
ae ee oe eee 
x4 + f(x") — a; for all x = (21,...,2%n) € So. 


Algorithm 2: 
Step 0: (initialization) 
a) Take points x* = a,e; for i=1,...,n, and for each 1 <i <n, 


construct the points y’ = —a' + f(x")1. 


b) Define the function h,(x) = maxy<j<n Yyi (a) = maxi<j<n (xi + y}) 


for all x = (x1,...,%n) € Sa. 
c) Set k:=n. 
Step 1: Solve the following subproblem: 
ae 
Step 2: Let y* be an optimal solution of Problem (4). Set k:=k +1 and 
ory" 
Step 3: Compute y* = —a* + f(x*)1. Define the function 


hi(a) = max(he-1 (2), Pye()) = max min (2; + yi) 


for all w = (x1,...,2%n) € Sa. Go to Step 1. 


In Algorithm 2, the function h, is the first lower approximation of the 
objective function f over S, (note that the objective function f is from R” to 
R). This algorithm produces the sequence {hx }%>n of lower approximations 
of f such that 


he(a) <hegi(x) for allk >n for all x € SQ. 


Note that Proposition 1 implies that h,(a) < f(a) for all « € S, and all 
k>n. 
Algorithm 2 is indeed a version of the cutting angle method, which is 


a powerful technique for global optimization of sub-topical functions over a 
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simplex. By a number of iterations of this algorithm, it produces x* as an 


approximation of the global minimizer of f over Sq. 
Let Ax = Minzes, he(x), and let f(a@*) = minzes, f(x). It is clear that 
Ap < f(a*) for all k > n. 


Lemma 2. In Algorithm 2, let k >n. Then y} < y# for all 1 <i<n. 
Proof. By Proposition 1 we have y,i(a*) < f(x") for all 1 <i<n. So 


ok + f(a) -—a;=ak ty! < f(a*), i=1,...,n. 


This implies that y! < y? for alll <i<n. 


Proposition 2. In Algorithm 2, let k > n+1. If yf — yk forsome 1 <j <n, 


k 


then x” is a global minimizer of the Problem (3). 


Proof. We have 


Hence Ax_-1 = f(x") = f(2*). This completes the proof. 


Proposition 3. In Algorithm 2, let k > n+ 2. If y* < y? for some n+1< 
j <k-—1, then x* is a global minimizer of the Problem (3). 


Proof. We have Ax-1 = he—1(x") > Yys(2*) > pye(a*) = f(x") > f(a*) > 


Ap—1. Therefore Ax_1 = f(x") = f(a*), and so z* is a global minimizer of 


the function f over Sy. 
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If Algorithm 2 does not terminate after a finite iteration, then we show 
that the sequence {a*} generated by it converges to a global minimizer of 
the sub-topical function f on S,. To this end, we first state and prove some 
results. Note that the sequence of functions {f,};,>1, defined on the set 
X CR”, is called equicontinuous on X if for every € > 0 there exists 6 > 0 
such that | f,(a) — fx(t)| < € whenever ||x—t||<6,cE€ X,te X,andk>1. 


Lemma 3. The sequence {yx }x>1 generated by Algorithm 2 is equicontin- 


uous on Sz. 


Proof. Let « > 0 be given and let k > 1. Put 6 =e, and let = (a%,...,2n), 
t = (t1,...,tn) € Sq such that ||z — t|| < 6. Therefore 


la; — til <e, t= Tea: (5) 


Now, assume that mini<;<n(aj — a®) = 24, — ak and minj<j<n(ti — 2) = 


ty — wi for some ix, 2%, € {1,...,n}. We conclude that 
Li, — bi, S Pyk (x) — Pyk (t) < Ly tis. 


It follows from (5) that |g,» (a) — pyx(t)| < €. Hence the sequence {yye } is 


equicontinuous on Sj. 


Lemma 4. The sequence {hy}x>n generated by Algorithm 2 is equicontin- 


uous on Sq. 


Proof. Let €« > 0 be given. Put 6 = e, and let x = (24,...,%), t = 
(t1,...,tn) € Sq such that ||z —t|| < 6. By Lemma 3, we have 


|pye(z) — pyr (| <e, &=1,2,.... (6) 


Let k > n. Now, assume that hg(x) = maxi<i<k Pyi(@) = Yyio(w) and 
hy(t) = maxi<i<k Yyi(t) = Yyis (t) for some io, i € {1,...,k}. We conclude 
that 

Pyir (Z) — Pyir (t) < he) — he (t) = Pyio (X) — Pyér (t) < Pyio (X) — Pyto (é). 


It follows from (6) that |hy(x) — hi(t)| < €. Hence the sequence {hx }x>n is 


equicontinuous on Sq. 
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Remark 4. By the definition of the function hy, we conclude that the se- 
quence {h,} in Algorithm 2 is also uniformly bounded on $,. Indeed, we have 
that the sequence {h,} is increasing and hy(x) < f(x) for all « € S, and all 
k >n. On the other hand, any sub-topical function is continuous and S, isa 


compact set. So we get that the sequence {h;,} is uniformly bounded on Sg. 


Proposition 4. Let {x} be the generated sequence by Algorithm 2 and let 
x* be a limit point of this sequence. Then a* is a global minimum point of 


the function p(x) = supys, he (x) over Sa. 


Ko_y+ ¢* Put A, = 


Proof. Without loss of generality, assume that «x 
h,(a**+). We have that the sequence {A;,} is an increasing sequence and 
At < v(a) for all 2 € S,. Thus 

lim A, < inf v(x) < y(a*). (7) 


k— 00 wES, 
Now, we show that limp... Ax = y(a*). Let € > 0 be given. Since {hx} is 
equicontinuous on S,, and «* —> «*, there exists N, > 0 such that for each 


m > Ny, we have 
|hg(x™) — Ay (a*)| < ; for all k > n. (8) 


On the other hand, It is clear that hy, (a*) —> y(a*). So there exists No >n 
such that 
lng (a*) — y(a*)| a for all k > Np. (9) 


Let N = max{Nj, No}. It follows from (8) and (9) that 


€ 


2 


* # € 
[Az — p(a*)| < |An — Ae(x*)| + [he (2*) — p(a*)| < an a 


for all k > N. This implies that lim, +5. Ax = y(a2*), and by (7) we conclude 


that v(x") = infres, v(x). This completes the proof. 


We will now demonstrate the convergence of Algorithm 2. 


Theorem 2. Let {x*} be the generated sequence by Algorithm 2 and let 2* 
be a limit point of this sequence. Then z* is a global optimal solution of the 
Problem (3). 
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Proof. Since {hy} is uniformly bounded and equicontinuous on the compact 
set S,, then by [11, Theorem 7.25], this sequence has a subsequence that 
is uniformly convergent on S,. On the other hand, the sequence {h,} is 
increasing, so {hy} converges uniformly to p(x) = sup,s,, he(x) on Sq. It 
is clear that p(x) < f(x) for all x € Sz and y(x*) = f(x*) for all k > n 
(indeed, by Proposition 1, for each k > n, we have y,«(x*) = f(x*) and thus 
hy(x*) = f(x*) and y(x*) = f(r*)). Now, let x* € Sq be a limit point of the 
sequence {x} (the simplex S, is a compact set, so {z*} has always a limit 
point «* € Sq). We have v(x) — v(x") < f(x) — f(x*) for all x € Sq and all 
k >n. This implies that 


p(x) — p(a*) < f(a) — f(a*) for all & € Sg. (10) 


By Proposition 4, «* is a minimizer of y over S,. So v(x) — y(x*) > 0 for 
all  € Sq. Therefore, by (10), we conclude that f(a) — f(x*) > 0 for all 


x € Sq. Hence x* is a global minimizer of the function f over the set Sq. 


This completes the proof. 


Step 1 of Algorithm 2 involves finding the global minimum of the function 
hy, on the set Sa, which is the most challenging part of the algorithm. The 
problem in Step 1 can be formulated as follows: 

min h,(x) (11) 
subject to x7 € Sa, 
where 


_ on ey 
hk(x) = ee) min (i +a, ) 


k>n, © =(21,...,2n) € Sg, and y? = —a! + f(a7)1. 

We will now discuss an approach for solving the subproblem. We demon- 
strate that Problem (11) can be transformed into a mixed integer linear 
programming problem with 0 — 1 variables. This technique is widely used 
and involves the introduction of a large positive parameter M. If we set 
t= maxi<j<p MiNi <i<n(Li+ ye), then it is clear that Problem (11) is equiv- 


alent to the following problem: 


Tran. J. Numer. Anal. Optim., Vol. 14, No. 1, 2024, pp 200-218 


211 


Minimization of sub-topical functions ... 
minz=t 
subject to mini<i<n(ai ty!) <t, 1<j<hk, (12) 
x Ee Sq. 


Each constraint mini<i<n(xj + yl ) < t can be expressed as a set of n+ 1 


linear constraints of the following form 
ajty!—Mui<t, 1<i<n, 
ik . 
> ul <n-1, 
i=1 


where u? € {0,1} for all i, j. 
Hence, we conclude that Problem (12) is equivalent to the following mixed 


integer linear programming problem: 


minz=t 
subject to 2; —t — Mu! < —y!, l<i<n, 1<j<k, 
Py ee ee ey (13) 
Ving =h 


a>0, ue {0,1}, 1<i<n, 1<j<k. 


Despite the fact that this technique increases the number of constraints and 
variables with each iteration, it also has the advantage of allowing the use 
of software packages designed for solving mixed integer linear programming 
problems, such as MATLAB, LINGO, and so on, to solve the subproblem. 


Remark 5. There is a natural question that, in Problem (13), how big should 
M be. Let |f(x)| < C for all x € Sq, and let A = maxi<i<n(a;). Then it is 
clear that |x; + yl | < A+C for all i and j. This implies that, it is enough to 
assume that M > 2A + 2C. 


At the end of this section, we present the complete version of the cutting 


angle method for finding the global optimal solution of Problem (3). 
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Algorithm 3: Cutting angle method 
Initialization: 


Set «* = aje; fori =1,...,n, and for each 1 <i <n, compute the points 
y’ = —a' + f(2")1. Find the optimal solution y* of Problem (13) 
according tok =n. Set k:=n+1l and F := 9. 


Iteration k—n: 


1) Set e* = y*, F:= FU{f(x*)} and compute the point 
y® = —a* + f(a*)1, 
i) Let f(@*) = min F. 
ii) If there exists 1 < 7 <n such that yf = yh , then terminate the 


* is a global optimal solution of Problem (3). 


algorithm; x 
iii) For k > n+ 2, if there exists n +1 <j <k-—1 such that 
y* <y’, then terminate the algorithm; «* is a global optimal 


solution of Problem (3). 


2) Find the optimal solution y* of Problem (13). Set k :=k+1 and go 


to iteration k — n. 


Remark 6. It is clear that, if Algorithm 3 does not terminate after a fi- 
nite iteration, then the sequence {#*} tends to a global optimal solution of 
Problem (3). 


4 Numerical results 


In this section, we will provide three numerical examples to evaluate the 
effectiveness of the proposed cutting angle method. We have implemented 
the method using MATLAB and carried out the computations on a personal 
computer with the following specifications: Microprocessor: Intel® Core™ 
i5-7200U (2.5 GHz, up to 3.1 GHz, 3 MB cache, 2 cores); Memory: 8 GB 
DDR4-2133. 

In each of the examples, we have selected an objective function that is 
sub-topical. We have then summarized the numerical results in tables, which 


allow us to easily evaluate the performance of the algorithm. 
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Example 3. Consider 
min f(x1, 22) 
s.t. 21 +22 =1, (14) 
@1,%2 20, 
where 


1 
f(x1, 22) = = In(e™ + 2), 


The graph of the objective function f and functions h; (i = 2,3,4,5) over 
the unit simplex Sy = {(21,@2) : v1 + %2 = 1, 21,22 > 0} are shown in 
Figure 1. The optimal solution and the optimal value of Problem (14) are 
x* = (0.688853, 0.311147) and f* = 0.507312, respectively. 


f(x1,1— 21) 1 f(x1,1— 2) 
09 =+=++he(x1,1— 2) =-=-h3(x1,1— 2) 


0 0.2 0.4 0.6 0.8 0 0.2 0.4 0.6 0.8 


f (x1, 1-21) 
—---+h4a(a1,1- 21) 


Figure 1: Graph of the objective function f of Problem (14) and the functions h; (4 = 
2,3,4,5) over the unit simplex S$; = {(r1, 72): 21 +22 =1, 1,22 > O}. 
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Table 1: Obtained results by the cutting angle method for Example 3 


Iter | Optimal point found ¢* | Optimal value found f(z") | Time (sec) 
1 (0.695813, 0.304187) 0.507385 0.01 
13 (0.685517, 0.314483) 0.507329 0.19 
20 (0.690637, 0.309363) 0.507317 0.34 
34 (0.688083, 0.311917) 0.507314 0.73 
64 (0.688721, 0.311279) 0.507312 2.71 
Example 4. Consider 
min f(a, v2, r3) 
s.t. 01 + $22 + $23 =1, (15) 


U1, %2,%3 2 0, 


where 


f(@1, 22,23) = 0.1 max{0.2x) + 0.322 + 0.523, 0.121 + 0.772 + 0.123, 
0.421 + 0.3822 + 0.273} + 0.025 In(e®”! + ePt2 4 el2ts) 


Note that the function f is not differentiable on the simplex S, = {(21, 22,23) : 
t+ 5x9 + $23 = 1, %1,22,23 > 0}. The graph of the objective function f 

over the simplex S, is shown in Figure 2. The optimal solution and the opti- 

mal value of Problem (15) are x* = (0.5658, 0.6699, 0.2978) and f* = 0.1911, 

respectively. 


Table 2: Obtained results by the cutting angle method for Example 4 


Iter | Optimal point found #* | Optimal value found f(z") | Time (sec) 
1 (0.0859, 0.9609, 1.3009) 0.4859 0.02 
2 (0.2923, 1.1673, 0.3723) 0.2407 0.04 
4 (0.4787, 0.6702, 0.5587) 0.2282 0.11 
5 (0.5668, 0.7583, 0.1623) 0.1947 0.15 
27 | (0.5604, 0.6496, 0.3444) 0.1919 4.86 
33 | (0.5796, 0.6689, 0.25784) 0.1916 7.64 
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Figure 2: Graph of the objective function f of Problem (15) over the simplex Sa = 


v3 =1, v1, 22,23 > O}. 
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Now, we present an example that the global optimal solution is a bound- 


ary point of the feasible set of the problem. 


Example 5. Consider 


min f(x, 22, x3) 


(16) 


1, 


s.t. U1+%2+%3 


01, 02,23 2 0, 


where 


0.1 max{0.22, + 0.322 + 0.523, 0.1a, + 0.72 + 0.123} 


) 


fis a, Hs 


0.la, + 0.722 + 0.123} 


+ 0.4min{0.22; + 0.322 + 0.523, 


a is shown in Figure 


The graph of the objective function f over the simplex S 


3. The optimal solution and the optimal value of Problem (16) are 2* = 


(0.6025, 0, 0.3975) and f* = 0.1693, respectively (note that x 


point of the simplex S,). 


is a boundary 


* 
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Table 3: Obtained results by the cutting angle method for Example 5 


Iter | Optimal point found #* | Optimal value found f(#*) | Time (sec) 


1 (0.3812, 0.3176, 0.3012) 0.2199 0.03 
3 (0.6923, 0, 0.3077) 0.1744 0.18 
22 (0.6136, 0, 0.3864) 0.1694 3.95 


Figure 3: Graph of the objective function f of Problem (16) over the simplex Sy = 


{(#1,%2,073) +21 +02 +93 =1, £1, 22,23 > O}. 


5 Conclusion 


This paper has proposed the cutting angle method as a means of finding the 
global minimum solution of a sub-topical function over a simplex. The algo- 
rithm utilized the abstract convexity of sub-topical functions to estimate the 
optimal value by solving mixed integer linear programming problems. The 
efficiency of this method has been demonstrated through numerical experi- 
ments. 

Overall, the proposed cutting angle method provided a promising ap- 


proach for solving sub-topical optimization problems with a simplex con- 
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straint. Future research can explore the extension of this algorithm to handle 


more complex sub-topical optimization problems with additional constraints. 
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